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Abstract — This paper focuses on analyzing the finite-time 
convergence of a nonlinear consensus algorithm for multi-agent 
networks with unknown inherent nonlinear dynamics. Due to 
the existence of the unknown inherent nonlinear dynamics, the 
stability analysis and the finite-time convergence analysis of the 
closed-loop system under the proposed consensus algorithm are 
more challenging than those under the well-studied consensus 
algorithms for known linear systems. For this purpose, we 
propose a novel stability tool based on a generalized comparison 
lemma. With the aid of the novel stability tool, it is shown that 
the proposed nonlinear consensus algorithm can guarantee finite- 
time convergence if the directed switching interaction graph has 
a directed spanning tree at each time interval. Specifically, the 
finite-time convergence is shown by comparing the closed-loop 
system under the proposed consensus algorithm with some well- 
designed closed-loop system whose stability properties are easier 
to obtain. Moreover, the stability and the finite-time convergence 
of the closed-loop system using the proposed consensus algorithm 
under a (general) directed switching interaction graph can even 
be guaranteed by the stability and the finite-time convergence of 
some special well-designed nonlinear closed-loop system under 
some special directed switching interaction graph, where each 
agent has at most one neighbor whose state is either the 
maximum of those states that are smaller than its own state 
or the minimum of those states that are larger than its own 
state. This provides a stimulating example for the potential 
applications of the proposed novel stability tool in the stability 
analysis of linear/nonlinear closed-loop systems by making use 
of known results in linear/nonlinear systems. For illustration of 
the theoretical result, we provide a simulation example. 

Index Terms — Consensus, Cooperative Control, Nonlinear Dy- 
namics, Multi-agent Systems, Finite-time Convergence 



I. Introduction 

The past decade has witnessed an increasing research 
interest in the study of distributed cooperative control of 
multi-agent networks. The main objective is to design proper 
local controllers for a team of networked agents such that 
a desired group behavior can be accomplished. As one of 
the fundamental research topics in distributed cooperative 
control of multi-agent networks, consensus over multi-agent 
networks has been studied extensively. The main objective of 
consensus is to design distributed control algorithms such that 
a group of agents reach an agreement on some state of interest. 
Consensus has been investigated under various scenarios, in- 
cluding a deterministic interaction setting [l]-[4], a stochastic 
interaction setting [5]-[8], a sampled-data setting [9]— [12], an 
asynchronous setting [3], [4], [13], a quantization effect [14], 
[15], and finite-time convergence [16]-[22]. 

Y. Cao is with the Control Science Center of Excellence, Air Force Research 
Laboratory, Wright-Patterson AFB, OH 45433, USA. W. Ren is with the 
Department of Electrical Engineering, University of California, Riverside, CA 
92521, USA. 



Consensus with finite-time convergence, referred to as finite- 
time consensus, means that consensus is achieved in finite 
time. In [16], a nonsmooth consensus algorithm is proposed 
and the finite-time convergence of the closed-loop system 
is presented under an undirected fixed/switching interaction 
graph. In [19], a continuous nonlinear consensus algorithm 
is proposed to guarantee the finite-time convergence under 
an undirected fixed interaction graph. In [21], the proposed 
algorithm in [19] is shown to guarantee finite-time consen- 
sus under an undirected switching interaction graph and a 
directed fixed interaction graph when each strongly connected 
component of the graph is detail-balanced. In [20], another 
continuous nonlinear consensus algorithm is proposed to guar- 
antee the finite-time stability under a directed fixed interaction 
graph. In [22], several nonlinear consensus algorithms are 
proposed to guarantee the finite-time x- c °nsensus where the 
final equilibrium state can be predefined by designing the \ 
function. Note that in [16], [19]-[22], finite-time consensus 
is solved for single-integrator kinematics in a continuous- 
time setting. In [17], finite-time consensus is studied for 
single-integrator kinematics in a discrete-time setting. To be 
specific, it is shown that the final equilibrium state can be 
computed after a finite number of time-steps. It is worth 
mentioning that finite-time consensus cannot be achieved when 
the continuous-time closed-loop systems under the finite-time 
consensus algorithms are discretized. In addition to the study 
of finite-time consensus for single-integrator kinematics as 
in [16], [17], [19]-[22], a nonlinear distributed algorithm is 
proposed in [18] to solve the finite-time consensus for double- 
integrator dynamics. 

In the aforementioned papers, it is assumed that there is no 
inherent dynamics for the agents. However, inherent dynamics 
often exists for the agents in many practical systems. In the 
synchronization of complex dynamical networks [23]-[26], the 
dynamics of each node in the complex networks is described 
by the sum of a continuously differentiable function describing 
the unknown inherent dynamics associated with the node and 
the coupling item identifying the connection between the node 
and other nodes. In [24], chaos synchronization of general 
dynamical networks is studied under an undirected connected 
interaction graph, where the synchronization conditions are 
given in the form of matrix inequalities. In [25], non-chaos 
synchronization of a time-varying complex dynamical network 
model is studied. To be specific, it is shown that synchroniza- 
tion is determined by the inner-coupling matrix as well as the 
eigenvalues and eigenvectors of the coupling configuration ma- 
trix characterizing the complex network. Similar to the results 
presented in [24], the synchronization conditions in [25] are 
also given in the form of matrix inequalities. In [26], adaptive 
algorithms are proposed to guarantee the local and global 
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synchronization of an uncertain complex dynamic network. 
In [23], the effect of heterogeneity in the synchronization of a 
complex network is investigated. It is shown that the ability of 
a scale-free network and a small-world network to synchronize 
decreases as the heterogeneity of the connectivity distribution 
increases. More details on the study of the synchronization 
of complex dynamical networks can be found in [27], [28]. 
Recently, the authors in [29] study second-order consensus of 
multi-agent systems with unknown Lipschitz nonlinear dynam- 
ics. Sufficient conditions are derived to guarantee second-order 
consensus under a directed fixed interaction graph. In [30], 
the authors propose a connectivity-preserving second-order 
consensus algorithm for multi-agent systems with unknown 
inherent nonlinear dynamics when there exists a virtual leader. 
In [31], the authors study first-order consensus of multi- 
agent systems in the presence of unknown inherent nonlinear 
dynamics. Sufficient conditions are given to guarantee first- 
order consensus under a directed fixed interaction graph. Note 
that only asymptotical convergence is studied in the previous 
papers. 

Motivated by the study of finite-time consensus for linear 
dynamics and asymptotical consensus with unknown inherent 
nonlinear dynamics, this paper studies finite-time consensus 
for multi-agent networks with unknown inherent nonlinear 
dynamics under a nonlinear consensus algorithm. Compared 
with the study of finite-time consensus for linear dynamics 
and asymptotic consensus with unknown inherent nonlinear 
dynamics, the study of finite-time consensus with unknown 
inherent nonlinear dynamics is more challenging because the 
two problems (i.e., finite-time consensus and asymptotical 
consensus with unknown inherent nonlinear dynamics) are 
considered simultaneously. In other words, the two problems 
are coupled as opposed to be separated. It is worth noting that: 
(1) finite-time consensus with unknown inherent nonlinear 
dynamics has not been investigated in the existing literature; 
and (2) the approaches used in the study of finite-time con- 
sensus for linear dynamics and asymptotic consensus with 
unknown inherent nonlinear dynamics are not applicable to 
the study of finite-time consensus for multi-agent networks 
with unknown inherent nonlinear dynamics. Therefore, it is 
potentially challenging to conduct the stability analysis and the 
finite-time convergence analysis of the closed-loop systems un- 
der the proposed nonlinear consensus algorithm. To facilitate 
the stability analysis and the finite-time convergence analysis, 
we propose a novel stability tool based on a generalized 
comparison lemma. By using the novel stability tool, we 
show that the proposed nonlinear consensus algorithm can 
guarantee finite-time convergence for multi-agent networks 
with unknown inherent nonlinear dynamics if the directed 
switching interaction graph has a directed spanning tree at 
each time interval. Specifically, the finite-time convergence is 
shown by comparing the closed-loop system under the pro- 
posed consensus algorithm with some well-designed closed- 
loop system whose stability properties are easier to obtain. 
Moreover, by using the novel stability tool, the stability and 
the finite-time convergence of the closed-loop system using 
the proposed consensus algorithm under a (general) directed 
switching interaction graph can even be guaranteed by the 



stability and the finite-time convergence of some well-designed 
nonlinear closed-loop system under some special directed 
switching interaction graph, where each agent has at most 
one neighbor whose state is either the maximum of those 
states that are smaller than its own state or the minimum of 
those states that are larger than its own state. This provides 
a stimulating example for the potential applications of the 
proposed novel stability tool. As a byproduct, in the absence 
of the unknown inherent nonlinear dynamics, the proposed 
nonlinear consensus algorithm can still guarantee finite-time 
convergence if the directed switching interaction graph has 
a directed spanning tree at each time interval. This extends 
the existing research on the study of finite-time consensus for 
single-integrator kinematics to a more general case where a 
milder condition on the interaction graph is required. 

The remainder of this paper is organized as follows. In 
Section II, we briefly review notations used in this paper, 
the graph theory notions, and the problem to be solved. In 
Section III, we propose a novel stability tool based on a 
generalized comparison lemma and present the basic steps 
to use the novel stability tool. In Section IV, we analyze 
the stability of the proposed consensus algorithm by using 
the novel stability tool under a directed switching interaction 
graph. Then a simulation example is given in Section V to 
further validate the result obtained in Section IV. Finally, 
Section VI is given to summarize the contribution of the paper. 

II. Preliminaries and Problem Statement 

A. Notations 

We use K to denote the set of real numbers. 0„ € R n 
is used to denote the n x 1 all-zero column vector. 1„ G 
R™ is the n x 1 all-one column vector. /„ S M. nxn is used 
to denote the identity matrix. ||-|| is used to denote the 2- 

norm of a vector. Define sig(x) a = sgn(x) \x\ a , where sgn(-) 
is used to denote the signum function. Note that sig(x) a is 
continuous with respect to x when a > 0. Let / : [0, oo) i-> 
J C R™ be a continuous function. The upper Dini derivative 
of f(t) is given by D+f(t) = limsup,^ 0+ \[f{t + h) - 
f(t)]. Given a function f(x(t)), the upper Dini derivative of 
f(x(t)) is defined as D+f(x(t)) = limsup A ^. 0+ \{f{x(t + 
h)) — f(x(t))]. A function f(t,x) is locally x-Lipschitz (also 
known as locally Holder continuous) in x if there exist real 
positive constants C, x< an d e sucn that \\f(t, x) — f(t, y)\\ < 
C \\x — y\\ x for all y e B(x, e), where B(x, e) denotes the ball 
centered at x with a radius e. 

B. Graph Theory Notions 

For a team of n agents, the interaction among them can 
be modeled by a directed graph Q = (V,W), where V = 
{1,2, ... ,n} and W C V 2 represent, respectively, the agent 
set and the edge set. An edge denoted as means that 

agent j can obtain information from agent i. That is, agent i 
is a neighbor of agent j. We use Afj to denote the neighbor set 
of agent j. A directed path is a sequence of edges of the form 
(ii,*2), fe,^),---) where if. £ V, k= 1,2, A directed 
graph has a directed spanning tree if there exists at least one 
agent that has directed paths to all other agents. 
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Two matrices are frequently used to represent the interaction 
graph: the adjacency matrix A = [ay] G R nxn with ay > 
if (j, i) G W and a,j = otherwise, and the Laplacian matrix 



C = [ti. 



with L. 



a u and ^3 = 



i 7^ j. In particular, we let an — 0, i = 1, . . . , n, (i.e., agent i 
is not a neighbor of itself). It is straightforward to verify that 
C has at least one eigenvalue equal to with a corresponding 
right eigenvector 1„. 

C. Problem Statement 

Consider a group of n agents with dynamics given by 

h = <f>(t,ri)+-Ui, i = l,...,n, (1) 

where G M m is the state of the ith agent, cf>(t,ri) G M. m is 
the unknown inherent Lipschitz nonlinear dynamics for the ith 
agent, and itj G R m is the control input for the ith agent. Note 



A 



that the nonlinear term <f)(t, r») = [</>(£, rj ), 
unknown, but is assumed to satisfy 



,^,r| m) )] 



< 



7 



.(*) J*) 



where 



„(*) 



k = 1, . . . , m, 
(2) 

is the fcth component of and 7 is a known 
positive constant. The objective is to design Ui such that 
\\ri(t) — rj(t)\\ — > in finite time for all i, j = l,...,n. 
That is, all agents' states reach consensus in finite time. Due 
to the existence of the unknown nonlinear term <f>{t, u) in (1), 
the consensus value, in general, is not constant, which is 
different from the case when the unknown inherent nonlinear 
dynamics do not exist. Moreover, since cj>(t,ri) is unknown, 
it is impossible to introduce the term — (f>(t, r^) in the control 
algorithm to cancel the unknown nonlinear term <f>{t, r,). 

It is well known that linear algorithms normally cannot 
guarantee finite-time convergence. We propose the following 
nonlinear finite-time consensus algorithm for (1) as 



= -/3X] a y(*) sig ( r 



Wlln-rjH) 



(3) 



where /? is a positive constant, Qij(t) is the (i,j)th entry 
of the adjacency matrix A(t) associated with the graph Q(t) 
characterizing the interaction among the n agents at time t, 
sig(-) is defined componentwise, and a(||r, — r 3 -||) is defined 
such that 



-■11) = 



a 
1. 



< 

Ik; - 



< 1, 



> 1. 



(4) 



where a* G (0, 1) is a positive constant. The main idea 
behind (3) is that an agent uses the information r, — n for 



j G Mi(t) when 
j G Afi(t) when 



> 1 while uses sig(ri — rj) a for 



< 1, The objective of using i\ 



is for the stabilization and the objective of using sig(n — r 3 ) a 
is to further guarantee finite-time convergence. 

In this paper, we assume that the adjacency matrix A(t) 
is constant for t G and switches at time ij+i, i = 

0, 1, . . ., where t = 0. Let Q^, Ai, and £j denote, respectively, 
the directed graph, the adjacency matrix, and the Laplacian 
matrix associated with the n agents for t G We 
assume that ti+i — U > t^, where is a positive constant. 



We also assume that each nonzero and hence positive entry of 
Ai has a lower bound a and an upper bound a, where a and 
a are positive constants. 

Note that a(||r, — rj ||) is discontinuous with respect to 

'V,: — r,-|| when ||r,; — r,!! = 1. However, sig(ri— rj) a (" ri ~ r *"' 



'p\\ VV1 '""' ii' » j 
is continuous with respect to 



when ||rj — r^- 1| = 1 



by recalling the definition of sig(-) Q . Accordingly, the right- 
hand side of (1) using (3) is discontinuous when the interaction 
graph switches. Because the interaction graph switches only 
at some distinct time instants, the set of the discontinuity 
points for the right-hand side of (1) using (3) has measure 
zero. It follows from [32] that the Caratheodory solution to 
the closed-loop system of (1) using (3) exists for an arbitrary 
initial condition. In addition, the solution is an absolutely 
continuous function that satisfy (1) using (3) for almost all t. 
In the following of this paper, we consider the solution of (1) 
using (3) in the Caratheodory sense. 

Remark 2.1: A special case of the nonlinear algorithm (3) 
with a(||rj — rj\\) = a*, where a* G (0,1) is a constant 
scalar, is used in [19] to solve finite-time consensus for 
single-integrator agents without the unknown inherent non- 
linear dynamics under an undirected fixed interaction graph. 
A variant of the nonlinear algorithm (3) is used in [21] to 
solve finite-time consensus for single-integrator agents without 
the unknown inherent nonlinear dynamics under an undirected 
switching interaction graph and a directed fixed interaction 
graph when each strongly connected component of the graph 
is detailed-balanced. Different from [19], [21], we investigate 
finite-time consensus for agents with the unknown inherent 
nonlinear dynamics under a general directed switching inter- 
action graph. The approaches used in [19], [21] to conduct 
the stability analysis are not applicable to the problem studied 
in this paper. 

III. A Novel Stability Tool By Comparison 

In this section, we propose a novel stability tool based 
on a generalized comparison lemma, which is used in the 
following of the paper for the stability analysis of the proposed 
algorithm (3). 

Theorem 3.1: Consider a nonlinear system given by 



9{t,x), 



x G 



(5) 



where g(t,x) is locally x-Lipschitz in x and is continuous in 
t. Let G(x) : R m 4 Rbe a nonnegative function satisfying 
that G{x) = for any t > t if G(x) = at * = t. 1 Then 
G(x) — > in finite time (respectively, as t — > 00) for any initial 
state if there exist a nonnegative function F(z) : W" h-> K 
and a function f(t,z) that is locally x-Lipschitz in z and is 
continuous in t such that the following conditions are satisfied: 

1. G(£) < F(£) for any £ G M m ; 

2. If F(0 + (and hence > 0), ^g(t, < ^/(t, 
holds; 



dF(z) 



f(t, z) is continuous with respect to z; 



4. At least one solution exists for 



dz 



dz 



(6) 



'G(x) is a function of t since x is a function of t. 



4 



For any z satisfying (6), F(z) — > in finite time 
(respectively, as £ — > oo) for an arbitrary initial state. 
5. When F(z(0)) < Fq, either of the following two cases 
holds: 

(1) . z(0) is bounded for any positive constant Fq; 

(2) . maxi Zj(0) — mini Zi(0) is bounded for any positive 

constant To and F(z) satisfying (6) is invariant when 
z(0) = z(0)+7;l m for any positive constant rj, where 
Zi is the ith entry of z; 

Proof: When g(t,x) is locally x-Lipschitz in x and is 
continuous in £, we have that (5) has a unique solution. 
The main idea of the proof is to show that there exist 
time intervals [0, £i), [£i, £2), . . . such that during any time 
interval [£j,£j+i), i = 0,1,..., where £ = 0, there exists 
a proper initial state z l (0) satisfying F(z l (0)) < F(x(0)) 
such that G(x) < max 2E n F(z) for all £ G [£i,£;+i), where 



dF(7r) 



First, we show that there exists £1 such that there exists 
a proper initial state £°(0) satisfying T(z°(0)) < F(x(0)) 
to guarantee that G(x) < max z6 n f (z) for all £ G [0, £1). 
Because F(z) is differentiable with respect to z and z is 
differentiable with respect to £, F(z) is continuous with respect 
to z and z is continuous with respect to £. Therefore, F(z) 
is continuous with respect to £. Then there exists t\ such 
that max z£ n -^(2) is well defined for £ G [0,ti). In other 
words, there exists a solution z* such that F(z*) > F(z) 
for any z G II and any £ G [0,ri). Let the initial state be 
chosen as z°(0) = x(0). From Condition 1, it is apparent 
that G(x(0)) < T(x(0)) = F(z°(0)). When F(z°(0)) = 0, 
it follows from Condition 1 that G(x(0)) = 0. Because 
G(x) = for any £ > £ if G{x) = at £ = £, it follows 
that G(x) = for £ > 0. Then the theorem holds trivially. We 
next consider the case when F(z (0)) 7^ 0. From Condition 
2, it follows that 



dG(x) dG(x) 



< 



dt dx 

dfmax^gn F(x)] 
dx 



g(t,x) 
f(t,x) 



d[max. xen F(x)] 
dt 



at £ = when F(x(0j) ^ 0. Then there exists T > 
such that G(x) < max ze n F(z) for £ G [0,T ) C [0,n). 
Noting that the relationship between x(Tq) and z(To) 
is unknown, we might not choose To as £1 because the 
relationship between and J ^"'j° F ^ might be 

unknown under the condition of the theorem. Accordingly, 
the existence of £2 is not guaranteed. Here, the objective 
is to choose a proper initial state £ 1 (0) and £1 such that 
F^iO)) < F(x(0)) and x(h) = z(h), where £1 G (0,T ). 
We next show that there exist £1 G [0, To) and z 1 (0) such 

that i ? (z 1 (0)) < F(x(0)) and z(£i) = x(£i). Denote r ? °(£) ^ 

dz 



/(£,z)U(o)=z°(o) - 5(£,x) U( )=£o 



A 



'(0) 



and A° F (£) = a ' m "^ /(£, z)| z(0 )^ (0 ) 
»7 F "" /(i, Z )|, (tl)=l(ll) . Because r?°(£) > 
when £ = 0, A^(£) = when £1 = 0, if(t) is 

2 Note that both G(x) and -F(^) are functions of t because x and 2 are 
functions of t. 



continuous with respect to £, and A^(£) is continuous 
with respect to z (Condition 3), there exists £ x such that 
A^(£) < r?°(£) when £ G [0,£i) C [0,T ). Therefore, 

F ( z (0))lz(*i)=^(ti) < ^(^(0))|*(o)=x(o)- The inm al state that 
guarantees z(ti) — x(ti) is designated as £ 1 (0). 

Next, we show that there exists £2 such that 
G(x) < max 26 nT(z) for all £ G [£±,£2) under the initial 
state £ 1 (0). We only consider the case when F(z(ti)) 7^ 
since the theorem holds trivially if F(z(ti)) = by noting 
that < G(x{tij) < F(z(£i)) = and G{x) = for any 
£ > £ if G(x) = at £ = £. By following the previous 
analysis, dG }^ < d [ max -|" F ( z ^ at £ = £1. Then there exists 
Ti > such that G{x) < max 2en F{z) for £ G [£i,£i + Tt). 
Again, we next show that there exists a proper initial 
state z 2 (0) and £ 2 such that T(z 2 (0)) < F(x(0)) and 
a;(£ 2 ) = z(£ 2 ), where £ 2 G (£i,£i + Tl"). Denote ^(t) = 

d[max.. e n f (z)l £/• \\ dG(x) /, \\ 

1 — /(*)^)U(0)=«H0) - -d^5(M)U(o)=f°(o) 

and Ai.(t) ^ dfmaX T F(Z)1 /(^^U( tl )^ (tl ) 
j ' M X nF(z)1 /(M)| zfe) . l(ti ). Because ^(t) > when 
£ = £1, A^(£) = when £2 = £1, ?7 : (£) is continuous 
with respect to £, and A^(£) is continuous with respect 
to z, there exists £2 such that A^(£) < ?7 1 (£) when 
£ £ [0,£i +£ 2 ) C [0,T 2 ). Therefore, F(z(0))\ z(t2)=x{t2) < 
T(z(0))| z(0 ) =2 i(o) < F(0 7 z(0))\ z{0)=x{0) . The initial state 
that guarantees z (£2) = £(£2) is designated as 5 2 (0). 

By following a similar analysis, it can be shown that 
whenever G(x) ^ at some £j, there always exists £j_|_i > 
£j such that there exists a proper initial state £ 4 (0) sat- 
isfying F(z l (0)) < F(x(0)) that can guarantee G(x) < 
max ze n F(z) for £ G [£j,£j+i). When the Subcondition (1) 
under Condition 5 is satisfied, F(z(0)) < F(x(0)) implies that 
z(0) is always from a bounded set. Combining with Condition 
4 shows that F(z) — > in finite time (respectively, as £ — » cxo) 
for any z G II, which implies that G(x) — > in finite time 
(respectively, as £ — > 00). When the Subcondition (2) under 
Condition 5 is satisfied, if there exists an initial condition 
z(0) under which a desired trajectory F(z) can be achieved, 
the same desired trajectory can be achieved if adding each 
Zi(0) by a common constant. Therefore, there always exists 
a bounded set of z(0) such that any trajectory F(z) with the 
initial state satisfying F(z(0)) < F(x(0)) can be achieved 
when the corresponding initial condition is chosen properly 
from the set. Again, G{x) — > in finite time (respectively, as 
£ — > 00) by considering Condition 4. 

This completes the proof of the theorem. ■ 
Remark 3.2: There are five conditions in Theorem 3.1. 
Each condition has its own unique purpose. Condition 1 is to 
guarantee that G(x) — F(z) are nonpositive once x and z are 
equivalent. Condition 2 is to guarantee that the derivative of 
G(x) along the solution of (5) is smaller than the derivative 
of F(z) along the solution of (6) once x = z and F(z) is 
positive. Conditions 1 and 2 guarantee that once x = z and 
F(z) is positive, there exists an time interval during which 
G(x) — F(z) < 0. However, Conditions 1 and 2 might not 
guarantee the existence of a proper initial state z(0) such 

that F(z(0))\ z ( U )=x(u) < ^(z(0))U(o)=x(o) for some future 
time instant £j unless Condition 3 is imposed. Condition 4 
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guarantees that F(z) — » in finite time (respectively, as 
t — > oo) for any given initial state. Condition 5 guarantees 
that for any positive Fq, the solutions to (6) with any initial 
state z(0) satisfying F(z(0)) < Fo are always within the set 
of solutions to (6) with the initial state z(0) being chosen from 
some fixed bounded set. Without Condition 5, it is possible 
that the fixed bounded set becomes a dynamic unbounded 
set. Consequently, F(z(0)) might become unbounded. Then 
F(z(t)) might become unbounded as well. As such, Condi- 
tions 4 and 5 guarantee that F(z) are bounded and F{z) — > 
in finite time (respectively, as t — > oo) for every z(0) satisfying 
•f 1 ( z (0)) < fo- Therefore, the five conditions are required in 
Theorem 3.1. Similarly, the five conditions are required in the 
following Corollary 3.3 as well. ■ 
Although F(z) and G(x) are essentially functions of t by 
noting that both z and x are functions of t, we choose to 
use F(z) and G(x) rather than F(t) and G(t) because the 
omission of z and x could substantially affect the demon- 



stration of the close connection between 



AF(z 



and 



AG(x) 



At At ' 

The close connection is primarily given in Conditions 1 and 
2 in Theorem 3.1. Condition 1 means that F(-) — G(-) is 
nonnegative when a common state is applied to both F and 
G. Condition 2 means that jf.[F(-) — G(-)] is positive when 
a common state is applied to both F and G if F is positive. 
Nevertheless, the existence of common states for F and G 
is neither necessary nor feasible for two physical systems 
satisfying the conditions in Theorem 3.1. In other words, 
Conditions 1 and 2 reflect only the structural requirement 
(what structural properties the system have when the states 
are the same). In order to better demonstrate the structural 
relationship between and , the notation F{z) and 

G(x) (or the alike) will be employed in the following part of 
the paper. 

Compared with the comparison lemmas for vector differen- 
tial equations in [33], [34] (see Theorem 2.6.11 in [33] and 
Theorem 2.1 in [34]), the generalized comparison lemma in 
Theorem 3.1 does not require the quasimonotone condition 
(see Definition 2.6.9 in [33] and Definition 2.9 in [34]). In 
addition, we use scalar functions in Theorem 3.1 but vector 
functions are used in [33], [34]. 

Note that Theorem 3.1 considers the case when the right- 
hand side of (5) is smooth and F(z) and G(x) are differ- 
entiable with respect to t. We next present an extension of 
Theorem 3.1 by considering the case when the right-hand side 
of (5) are smooth almost everywhere and F(z) and G(x) are 
differentiable with respect to t almost everywhere. In this case, 
the solution to (5) is considered in the Caratheodory sense. The 
Caratheodory solution of (5) exists because we will consider 
the case where the set of the discontinuity points for the right- 
hand side of (5) has measure zero. This relaxation has a similar 
counterpart in [33] (c.f. Theorem 2.6.11). 

Corollary 3.3: Consider a nonlinear system given by (5) 
where g(t,x) is locally x-Lipschitz in x almost everywhere 
and is continuous in t. Let G(x) : K m i-> K be a nonnegative 
function satisfying that G(x) = for any t > t if G(x) = 
at t = t. Then G(x) — » in finite time (respectively, as 
t — > oo) for any initial state if there exist a nonnegative 
function F(z) : R m i-)- K and a function /(i, z) that is locally 



X-Lipschitz in z almost everywhere and is continuous in t 
such that the following conditions are satisfied: 

1. G(0 < F(£) for any £ £ E m ; 

2. If F(£(t)) ^ (and hence > 0) and z(t) = 

(+\ £U\ V G(x(t+h)) — G(x{t)) | . 

x{t) = £{t), limsup^o + -^ ^ L - L ^U(t)= s (M(t)) < 

holds almost ev- 



F(z(t+h))-F(z(t)) 
h 



limsup^o 
erywhere; 

3. limsup fe ^. 0+ * ' ' x ~ x "" \i(t)=f{t,z(t)) is cont 
with respect to z almost everywhere; 

4. At least one (Caratheodory) solution z exists for 



i(t)=/(M(t)) 

F(z(t+h))-F(z(t)) | 

h l*(t)=/(M(t)) 



F(z(t + h))-F(z(t)) 
h 



lim sup 

F(£(t + h))-F(£(t)). 

= — — i — — i«o=m*» ■ ^ 

Furthermore, for any (Caratheodory) solution z satisfying (7), 
F(z) — > in finite time (respectively, as t oo) for an 
arbitrary initial state. 

5. When F(z(0)) < F , either of the following two cases 
holds: 

(1) . z(0) is bounded for any positive constant Fo', 

(2) . maxj Zi(0) — mirijZ^O) is bounded for any positive 

constant F and F{z) satisfying (7) is invariant when 
z(0) = z(0) + ?/l m for any positive constant ?/, where Zi 
is the ith entry of z; 

Proof: It can be observed that Conditions 1 and 5 are 
exactly the same as those in Theorem 3.1, while Conditions 
2, 3, and 4 are the same as those in Theorem 3.1 except that the 
use of derivative in Conditions 2, 3, and 4 is replaced by the 
use of upper Dini derivative and the statements in Conditions 
2 and 3 are assumed to be satisfied almost everywhere instead 
of everywhere. Since the exclusion of the discontinuity points 
with measure zero does not change the solutions of (7) in 
the Caratheodory sense, the proof of the corollary is the same 
as that of Theorem 3.1 when the discontinuity points with 
measure zero are excluded. ■ 
Theorem 3.1 and Corollary 3.3 reflect the connection be- 
tween the stability of one system and the stability of other 
system(s) when certain conditions, as mentioned in Theo- 
rem 3.1 and Corollary 3.3, are satisfied. The basic idea is 
to show that some nonnegative function will approach zero 
in finite time (respectively, as t — > 00), which has a similar 
motivation to that of the Lyapunov-based stability analysis. 
However, substantial differences can be found between them. 
Recall that the asymptotic/finite-time stability of a closed-loop 
system can be guaranteed via the Lyapunov-based stability 
analysis when there exists a proper Lyapunov function with a 
negative-semidefinite (and the alike) derivative. In contrast, 
it is not required in Theorem 3.1 and Corollary 3.3 that 
some nonnegative function {i.e., G(u) in Theorem 3.1 and 
Corollary 3.3) has a negative-semidefinite (and the alike) 
derivative. Instead, the derivative of the nonnegative function 
is studied through a proper comparison with that of some 
nonnegative function under some properly designed systems, 
whose stability can be obtained or is already known. More 
precisely and concisely, Theorem 3.1 and Corollary 3.3 can 
be used to analyze the stability of some closed-loop system 
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given that the conditions in Theorem 3.1 and Corollary 3.3 
are satisfied even if it is difficult to find a Lyapunov function 
for the system or a Lyapunov function for the system does 
not exist (since the existence of a Lyapunov function for a 
stable system is not always guaranteed). This is the main 
contribution of the proposed novel stability tool based on the 
generalized comparison lemma. Before applying Theorem 3.1 
and Corollary 3.3 in the stability analysis of (1) using the 
proposed consensus algorithm (3), we next present the major 
steps for the use of Theorem 3.1 and Corollary 3.3. 
Major steps to use Theorem 3.1 and Corollary 3.3: 

1. Choose a proper nonnegative function G(x) based 
on the closed-loop system dynamics and compute 

,. G(x(t+h))-G(x(t)) I 3 c . ., . 

limsup /l _ >0 + % — L ^U(t)=<?(M(t))- Similar t0 

the idea behind the Lyapunov functions, it is normally a 
good idea to choose a quadratic function x T Qx with Q 
being symmetric positive semi-definite, maxj 2j— mirij Xi 
with Xi being the ith entry of x, maxi \xi\, and etc. 

2. Design a proper function F(z) satisfying Condition 1 and 
the corresponding closed-loop system(s) satisfying (6) 
or (7) such that Conditions 2-5 are satisfied. 

It seems that the two steps are quite independent from the pre- 
vious descriptions. However, they are closely related because 
the choice of G(x) in Step 1 has a direct impact on whether 
the design of a proper function and the corresponding closed - 
loop system(s) in Step 2 is feasible. 

One might wonder how complex to apply Theorem 3.1 
and Corollary 3.3 in stability analysis since the conditions are 
quite complicated. In fact, the functions of F(-) and G(-) are 
normally chosen in such a way that they are quite similar 
in terms of structure. In most cases, they can be chosen to 
share the same structure. Then Condition 1 in Theorem 3.1 
and Corollary 3.3 is, by default, true. Moreover, the function 
of /(•) is normally quite similar to g(-) in order to guarantee 
that Condition 2 in Theorem 3.1 and Corollary 3.3 can be 
satisfied. Conditions 3 and 5 in Theorem 3.1 and Corollary 3.3 
are relatively easy to check given F(-) and /(•). Although 
Condition 4 in Theorem 3.1 and Corollary 3.3 is generally hard 
to check because the number of solutions to (6) and (7) could 
be infinite, the solutions normally share a common structure 
(see the following Section IV). Then Condition 4 is also easy 
to analyze. 

In the following part of this paper, we let F(-) and G(-) 
share the same structure. Thus, Condition 1 in Corollary 3.3 
is satisfied apparently. In addition, Conditions 3 and 5 in 
Corollary 3.3 are satisfied under the properly designed F(-) 
and /(■). Therefore, we will not explicitly mention Conditions 
1, 3, and 5 in the following of the paper when Corollary 3.3 
is used. 

IV. Finite-time Consensus Under a Directed 
Switching Interaction Graph 

In this section, we focus on the study of finite-time consen- 
sus for multi-agent networks with dynamics given in (1) under 



3 Note 
M 



that 



i im< ,„ n G(x(t+h))- 
lim bup h _,. 0+ £- 



g(t, g) when G(x) is differentiable. 



I±(t)= 



g(t,x(t)) 



a directed switching interaction graph. In the following of this 
paper, we only focus on the case of to = 1 {i.e., the one- 
dimensional case) for the simplicity of presentation. However, 
because condition (2) holds for each dimension, similar results 
can be obtained for to > 1 (i.e., the high-dimensional case) 
by applying a similar analysis to each dimension. 

Before moving on, we need the following lemmas. 

Lemma 4.1: Let n be any positive integer and X{ £ M, i = 
1, • • • , n. There exists a positive number q n such that 



xl 



(8) 



i=l i=2 i=l 

Proof: When n = 1, the lemma holds apparently because 



i=2 



We next consider the case when n > 2. 



if Xi 



for all 



Since -Ei=W + I^XiXi-! 
i = 1, • • • , n, in order to prove the lemma, it is equivalent 
to show that — E"=i x i + ET=2 x i x j-i is negative whenever 
there exists i £ {1, • • • , n} such that Xi ^ 0. Note that 



i=l 



i=2 



i=2 



+ x 2 n + (x 2 - xx) 2 + (x n - x„_i) 5 



n-1 

i=2 



Therefore, 

~ Si=i x \ 



' 2-ii=2 x i x j 



Y^i=2 x i x j-i — 0- Note also that 
i = if and only if 

xi =0, x n = 0, 
-l =0, i = 2, ••• ,n, 



which implies that — Yl7=i x i~^~^i=2 x i x j-i = if and only 
if Xi = 0, i = 1, • • • , n. Combining with the fact — Y17=i x 1 + 

Yh=2 X * X 3-1 - sh0WS mat ~I2i=l X i + Y^i=2 X i X 3-l is 

negative whenever there exists i £ {1, • • ■ ,n} such that Xi ^ 
0. This completes the proof of the lemma. ■ 

Lemma 4.2: [35] Let x\,--- ,x p > and a* £ (0,1). 

Then ELi*f >(ELi*i)< 

Lemma 4.3: [36] Consider the scalar differential equation 

fi = g(t,fi), (i(to)=(M>, 

where g(t,/j.) is continuous in t and locally Lipschitz in \i 
for all t > and all p, £ J £ M. Let [t ,T) (T could be 
infinity) be the maximal interval of existence of the solution 
fi(t), and suppose /x(t) £ J for all t £ [to,T). Let v(t) be 
a continuous function whose upper Dini derivative D + v{t) 
satisfies the differential inequality 

D+v(t) <g(t,u(t)), KM<Mo 
with v(t) £ J for all t £ [t ,T). Then v(t) < fi(t) for all 

te[to,T). 

With the aid of Corollary 3.3 and Lemmas 4.1, 4.2, and 4.3, 
we next show that finite-time consensus is achieved for (1) 
using (3) in the following theorem. 
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Theorem 4.1: Assume that the directed interaction graph 
Qi,i = 0,1,..., has a directed spanning tree. Using (3) 
for (1), \ri(t) — rj(t)\ — > in finite time for any initial state 
if /5 > + £2, where q n is the maximal positive number 

such that (8) holds and ej,, k = 1, 2, is any positive constant. 

Proof: The closed-loop system of (1) using (3) can be 
written as 



- / 9^a ii (i)sig(r 



a(ki-rj|) 



(9) 



MtEarg rnaxi rt 



hit) 



M'£arg min; rt 



fi(t) are equivalent 



almost everywhere. From (9), we can obtain that 



max f i (t) 

i£arg maxf rt 



max 

itEarg raaxf r; 



/(Ui)-iJE 8 «(*) !i 8( r '- r J-) a(|r< 



< max f(t,n), 

?£arg maxf rt 



Note that |r, — r ^ | — > in finite time if and only if 
maxi r% — min, — > in finite time. We next employ 
Corollary 3.3 to prove the theorem. We first show that the 
finite-time convergence of (1) using (3) can be guaranteed by 
the finite-time convergence of another well-designed closed- 
loop system. Then we prove that the designed closed-loop 
system indeed converges in finite time. 
The Use of Corollary 3.3: 

(1): Choose a proper nonnegative function G(r) and com- 
pute D + G{r), where r = [r\,--- ,r n ) T . Here we choose 
G(r) = max.; ri — min^ri. We first show that G(r) = for 
any t > t if G(r) = at i = i. Whenever G(r) = at some 
time t, it follows that rj(|) 
thus follows from (9) that f 
Consequently, Ti(t) = rj(t), Vi, j = 1, 
That is, G(r) = for any t > t. 

Based on the definition of upper Dini derivative, we have 

D+G{r) = limsup \ {G[r{t + ft)] - G[r(t)}} 

= lim sup — { [max r, (i + ft) — max ri (t)] 

— [minrj(< + ft) — minr^t)]} 

i i 

=D + rnaxr^ — D + minr^. 

i i 

Note that 



r\ (i) for all i,j = 1, • ■ • , n. It 
j , = !,••• , n, at time £. 



r i 



, n, for any t > t. 



lim sup — [max r j (t + ft) — max r, (i)] 
ft->-o+ " ' * 



lim sup 

>0,e->0+ 



maxj Ti (i + ft) — max.; r,; (t) 



ft £ (e — e, e ■ 



lim I max 

>0,s— >0+ \ieargmax(r< 



r^t + ft) -r f (t) 
h 



where we have used the fact max, n > Tj, j = 1, • • • , n, 
to derive the last inequality. Similarly, it can be obtained 
that max iear g min ^ h(t) > ma,Xi eaIsmini n f(t, n). When 
the directed interaction graph Qi, i = 0, 1, . . . , has a directed 
spanning tree, it can be obtained that {j\j £ Afi,i £ 
argmaxi r{\ UO'b' £ A/i,i £ argmin^r^} 7^ 0, where 
denotes the empty set. We then rewrite D + G(r) based on the 
following two different cases: 

(i) When {j\j £ Wi,i £ argmax^r^} ^ 0, by recalling 
that D + Ti{t) and rj(t) are equivalent almost everywhere 



ft £ (e - e, e + e) 



- max 

^(Earg maxf r; 



lim ^ + ^)-^) : , g(£ 

>0. E->0+ ft 



Because ft — > + when ft £ (e — e, £ + e), e — > 0, and e — !> + , 
it follows that 



lim rjt + tpn® = D+rS) 

e->0, e->0+, fce(e— e,e+e) ft 



Therefore, D+ max, r 4 = max iearg maX(! rf D+r^t). Simi- 
larly, D+ mini ^ = max ieargmin(r( D + r t (t). Note that r<(t) 
is continuous with respect to t everywhere except for the 
case when the network topology is switching. Since the case 
only happens at some distinct time instants, D + r.i(t) and 
fi(t) are equivalent almost everywhere. That is, D + G(r) and 



and maxi g 



arg min^ rt ' * 



it) 



> 



it follows that D + G(r) < max^g 



max.jg ar g max^ ri f(t, Ti), 



arg maxf rt 1 t 



(t) 



MfEarg min^ rt 



f(t, almost everywhere. Therefore, 



we have D + G(r) < max 



£E?=i°«(*) si g( ? 



iGarg maxf rt 



f(t,n) 



(11) 



max ieargmin { r e f(t, r i) < (7 + e l ) ( max iSarg max; r£ r i — 

max,f= ar g m i n ^ r p T{ ) max2(= al g max ^ /^^sig(r2 

max r <ri r ^ a (| r i- max r : ,<r i r 3 |) jjQj^g a i mos t everywhere 
when G(r) ^ 0, where (2) was used to derive the last 
inequality and e\ is any positive constant. 

When {j\j £ Afi,i £ argmin^rf} 7^ and 
{j\j £ A/i,i £ argmaxfr^} = 0, by following 
a similar analysis as that in Case (i), it can be 
obtained that D + G(r) < max ieargmaXf n f(t, n) - 
max ieargm i n( , rf ri{t) almost everywhere. Therefore, 
we have D+G(r) < maxj eargmax<r4 f(t, n) - 



f(t,n) 



/ 3 Er=i a u( t ) si g( 7 



r . )a (|n 



< 



(7 + ei)(max ie 

arg max; rt ' t 



max^ ar g niint rt ) ~i~ l^l ax i£arg mint r t PQ.^E> ifi 

min r > ri rj) a ^ rt ~ minr 3 >ri Tj V holds almost everywhere 
when G(r) ^ 0, where (2) was used again to derive the 
last inequality. 

Note that G(r) is not necessarily a nonincreasing function. 

(2) Propose a proper function F(£) satisfying Condi- 
tion 1 and the corresponding closed-loop system(s) satisfy- 
ing (7) such that Conditions 2-5 are satisfied, where £ = 

[£i> • • • j £n] T - Define 7 = 7-R1. Let F(£) = max, ^-min, ^ 
and consider the closed-loop system given by 
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(i) When {j\j e Mi, i € argmax^ ^} ^ 0, 

D + F(£) = 7( max & - max &) 

i£ arg maxf ^ i^argmin^^ 

— max /3asig(£i — max ^•) Q! d^ _max 5j<«< t>P 

iGarg n.,i\, $j • i 

(10) 

(ii) When {j\j G € argmin^} 7^ and G 
Ai,i £ arg max^ ^ } = 0, 



Here the (Caratheodory) solution to (16) exists because 
Jo P( T > £( T ))d T is well-defined. Then we have 

£>+&(t) =D+£ i (t)+D+\ 

=7& - /3asig(& - max ^) a( -\^- m ^<u 

+ p(t,f) + 7A-p(*,£) 
=76 " /3«sigfe - max ^.)«(|^— ^ <5j &|) 



D + F(0 = 7 (. max ^ £ 



max ^) 

iGarg min^ £^ 



max /3asig(^ — min £j) 

iSargminf & Cj>Ci 



a(|{i-min 5j>5 . 

(ID 



+ 7&(*) -&(*)] 

=7& ~ /3a si g(6 - max £,•) 

e 3 <e 

i = 1 , • ■ • , n 



a(|£i-max^. <5 -. |) 



(17) 



It then follows that Condition 2 in Corollary 3.3 is satisfied. 
It remains unclear if Condition 4 in Corollary 3.3 is satisfied. 

By following a similar analysis to that of D + G(r) in Step 
1, it can be obtained that 



D + F(£) = max D + &(t) 

ifEarg max; £^ 

Then (10) becomes 



max D + &(t). 

?£arg min^ £i 



where we have used the fact that — £i(t), i = 1, • • • , n, 
are identical to derive the last equality. Since the set of the 
discontinuity points for the right-hand side of (17) has measure 
zero, the solution to (17) in the Caratheodory sense is the same 
as the solution to 



ii(t) =7& - /3asig(& 



max 



- % + /3asig(6 - max <y 



- max £j 
1, ■ • • ,n 



<y ) 



(18) 



= max [-D + &(*)-7&] 
Define 



(12) 



Ti(t,® = ^^(O-^+^sigte-maxO)"^^ 111 ^^ 16 ^ 



Then max, eargmill(f( = D + ^(t) - % because 

max^.<^^ does not exist for i G argmin^. Then (12) 
becomes 



in the Caratheodory sense. Clearly, in the Caratheodory sense, 
the solution to (10) exists since the solution to (18) exists. 
Define = max, & - min 4 F(£) under (10) and F(£) 
under (18) are always equal. 

Similarly, when {.7 1.7 S Afi,i G argmim>^} ^ 
and <E Afi,i G argmax^^} = 0, the (Caratheodory) 
solution to (11) exists. In addition, F(£) under (11) and 
under 



d = 7& + /3asig(^ 



max rj(t,^) 



max ri(t,0- (13) 

iGarg min^ £^ 



mm 4j) 1 



(19) 



In order to guarantee that (13) holds for an arbitrary 
£(0) and an arbitrary interaction graph, I\(i,£) should 
have the same structure of £ for all i because otherwise 
max, 6argmax<f( r;(i,£) - max 4eargminf ie Ti(t,£) cannot al- 
ways be constant, which then results in a contradiction. As a 
consequence, r\(i,£) should satisfy 



(14) 



for some function £) such that the (Caratheodory) solution 
to (10) exists. Recalling the definition of it then 

follows from (14) that 



D + Ut) =76 - /3asig(& - max fc)«*(|&-™*ej<« 4 
= !,-•• ,n. 



(15) 



In order to guarantee that the (Caratheodory) solution to (10) 
exists, it is required that p(t, £) be integrable. That is, 
J p(r, ^(r))dr is well-defined. Let's further define |,;(£) = 
+ A, where A is the (Caratheodory) solution to the 
following equation 



D+\ = j\-p(t,0, 



(16) 



are always equal. 

By combining the previous arguments, F(£) goes to zero 
in finite time for any solution £ to the closed-loop system 
switching between (10) and (11) if and only if F(£) goes to 
zero in finite time for the solution £ to the closed-loop system 
with the same switching when (10) and (11) are replaced by, 
respectively, (18) and (19). Therefore, in order to guarantee 
that Condition 4 in Corollary 3.3 is satisfied, a sufficient 
condition is that max; & — min, & — > in finite time for the 
system with an arbitrary switching between (18) and (19), 
which will be shown next. 

The proof of max,; £i(t) — min.i£j(4) — > infinite time for 
the system with an arbitrary switching between (18) and (19): 

The proof can be divided into two steps: 

1 Prove that max^ £i(t) — min^ £i(t) — > as t — >• 00; 

2 Prove that max^ £i(t) — min^ £j(t) — > in finite time. 
Here the proof of Step 2 depends on the statement in Step 1. 

Step 1: Prove that max.; £i(t) — min.; f;(i) — > as t — > 00. 
Before moving on, we first analyze an important property for 
the system with an arbitrary switching between (18) and (19). 
That is, if &(i ) < ij(t ), then < £j(t) for any t > 

to. This property is due to the fact that whenever f;(to) = 
ij{t ) at some t , £i(t ) = ij(t ) and thus ^(t) = £j(t) 
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for any t > to- This property plays an important role in the 
following proof. Without loss of generality, we label the agents 
in such a way that 6(0) < | 2 (0) < ... < |„(0) throughout 
the following proof. Combining with the property implies that 
|i(0 <&(*)<...< £„(*) for any t > 0. 

Consider the Lyapunov function candidate given by 



G({) 



i=l 



- a(|r|) dr. 



(20) 



Noting that r 

'ha. ./;; • i 



"(m) is continuous with respect to r, it follows 
l (l T Ddr is differentiable with respect to 6 + i — 



6- Therefore, G(^) is regular. Then G(£) is a nonpathological 
function [37]. In the sense of Caratheodory solutions for the 
system with an arbitrary switching between (18) and (19), if 
the nonpathological derivative of G(£) is negative definite, 
then the system with an arbitrary switching between (18) 
and (19) is globally asymptotically stable (c.f. Lemma 1 
in [37]). Because the nonpathological derivative of a non- 
pathological function is essentially equivalent to the set-valued 
derivative of the same function (see Definition 4 in [37]), we 
next use the notation of the set-valued derivative in the proof. 
The set-valued derivative of G(£) is given by 

L P G(i) = k [E"=i(lm - iir^-^Hi+i - id] > 

where K[-] is the differential inclusion [32]. Before analyzing 
L F G(^), we first analyze 6+i — 6 under (18) and (19). 
When (18) is satisfied, we have 6+i — 6 = 7(6+1 — 6) — 



,0) 



a( l^i+i— max 



/?asig(6+i - 

/3fisig(|j - i:„.a, , s , 
6+i > 6 ( see the first paragraph of the step), we have 



Because 



6 



6 



6+i-max|. <f . +i 

0. It thus follows that 6+1 
When |i(t) < | 2 (i) < 



-max|_. < |. +i 6 > 6+1-6 > 

< te+i - &) a(|&+1_&|) - 

. < | n (i), it follows that 



max; ,,- fj 
we obtain 



A 



6- Define ^ = (6+1-6) 



Then 



n-l 

E 

3=1 

n-l 



(6+i - 6) 



(6+1-6) 



= ^(6 + i-6) 
3=1 



a(k,+ l-«i ) 



7(e 



i+l 



<^(6+i-6) Q( l |l+1 - f 

i=i 



7(6+1 -6) a(|e<+1 " e<|) 

- /?asig(6 +1 - + /3asig(6 - 6-i) a(||l_cVl 

n— 1 n— 1 

= -(#*- 7) E^ + ^E^*" 1 

i=l i=2 

n—1 n— 1 

< - (paq-n-i - 7) 2J *i - -Mn-it2 E ^' 



where we have used Lemma 4. 1 and /3 > — 2 h £9 to derive 

the last two inequalities. When 6(0 < 6(0 < ■ • • < 6i(0 
does not hold and G(£) ^ as time t, we can always find 
a set of indices such that 61 (0 < 62 (0 < • • • < 6f (0 
and 6(0 g (<),••• ,6^(0} for any i £ {fci,--- ,k t }. 
Then the Lyapunov function candidate (20) can be equivalently 
written as 



G(i) = E 



i=l 



r a(|r|) dr. 



Define Si = 



(ik l+1 - £k t ) a( \ lik ' +1 ~ ik ^ ) - Similarly, it can be 

' + i ^I ) (4 1+1 -4j< 



obtained that £tl(4 i+1 -6J a( l« fc 



-a9n-ie2 Si=i $i • Since <*» = if and only if 6+1 - 6 = 0, 
2~2i=i $i remains unchanged if those agents with the same 
state are considered one agent. This implies that 2~2iZi $i — 
Y^i=x Therefore, max LpG(£) is always negative definite 
when (18) is satisfied. When (19) is satisfied and 6(0 < 
| 2 (i) < • • • < 6(0 holds (respectively, 6(0 < 6(0 < • • • < 
61 (0 does not hold), by following a similar analysis to that of 
the case when (18) is satisfied and 6(0 < 6 (0 < • • • < 6(0 
(respectively, 6 (t) < 6(0 < • • • < 6* (0 does not hold), we 
can obtain that maxL^G(^) < -0^-1^2 Efc/^' which 
implies that maxL^G(^) is also negative definite. 

From the previous analysis, we know that max L^G(6 
is always negative definite for the system with an arbitrary 
switching between (18) and (19). It then follows from Lemma 
1 in [37] that 6(0-fj(0 -» 0, G {1, ■ ■ • , n}, as t -» 00. 
Equivalently, maxi 6(0 — min,; 6(i) — > as t — > 00. 

Step 2: Prove that maxi6(^) — miiii6(^) — ^ in finite 
time. Because max^ 6 (t) — min^ 6 (t) ~ * as t — > 00 (shown 
in Step 1), it follows that there exists a time instant t such that 
maxi 6(0 — mini 6(0 < 1 f° r any t > t, which implies that 
16(0 - 6 (01 < 1 for any t > t. Based on (4), for t > t, (18) 
and (19) can be rewritten as 



and 



6 = 76 - /3asig(6 - max 6)" 



6 = 76 + /3asig(6 - min 6) c 



(21) 



(22) 



/3asig(6+i - 6) a (l^-^D + /3asig(6 - 6-i) q(|?VcVi 1 



The Lyapunov function candidate (20) can be rewritten as 

G (0 = E / T ° dT - ( 23 > 

<=i Jo 

By following a similar analysis to that of LpG(£), we can 
obtain that 

n-l 

max£i?G(6) < - aq n -ie2 E^ +1 _ ^) 2 " 

i=i 

n-l 

= - aqn-iei ^[(6+1 - 6) 1+a 1^ 
i=i 

n-l 



< - agn-i£2[^(^+i ~ &) 



l+a*l^ 



; = 1 



i=l 
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where we have used Lemma 4.2 to derive the last inequality. 
Noting that G(i) = EHiCli+i - it follows 

that 

maxL F G(0 < -aq n - X e 2 {l + a*)^[G(|)]^. (24) 

Let's write G(£) as G(i) for simplicity. For t > I, although 
G(i) is discontinuous at some time instants, it is always 
integrable because G(i) £ [0, G(t)] is bounded and the set of 
the discontinuity points has measure zero [38]. It then follows 
from (24) that 



G(t + h)- G(t) 



t+h 



G(r)dr 



< - haq n -ie 2 (l + a*) 



min G(t). 
-e[t,t+/i] 



It then follows from the definition of upper Dini derivative 
(c.f. Section II) that 

D+G(t) < -aq n -Ml + a)^[G(t)]^. 

When t > t, it follows from Lemma 4.3 that G(t) is upper 
bounded by /j,(t) satisfying 

fi{t) = -Mn-i£2(l + a*)^Kt)]^, n(t) = G(t). 
Because £ (0, 1), by computation, we have 

1 + d* 



1 - a* 
1 + a* 

1-a* 



Therefore, fi(t) — > in finite time. Because G(t) is nonneg- 
ative and G(t) is upper bounded by n(t), G{t) — > in finite 
time. Equivalently, max^ £i(t) — mini £,i(t) — > in finite time. 
Combining all previous arguments completes the proof. ■ 
Remark 4.2: Although the solutions to (10) in Step 2 of 
the proof of Theorem 4.1 are not unique, they share some 
nice common features [i.e., they all satisfy (15)]. Similarly, 
the solutions to (11) in Step 2 of the proof of Theorem 4.1 
also share some similar nice common features. Ultimately, 
the study of finite-time consensus for the system switching 
between (10) and (11) is converted to the study of finite-time 
consensus for the system switching between (18) and (19). 
The example shows that the verification of Condition 4 in 
Theorem 3.1 and Corollary 3.3 is not as complex as it appears 
to be. 

Remark 4.3: In the proof of Theorem 4.1, the stability and 
finite-time convergence of (1) using (3) under a (general) 
directed switching interaction graph is shown to be guaranteed 
by the stability and finite-time convergence of the closed-loop 
system switching between (18) and (19). The interaction graph 
associated with (18) [respectively, (19)] is constructed in such 
a way that each agent has at most one neighbor whose state 
is the maximum of those states that are smaller than its own 
state (respectively, the minimum of those states that are larger 
than its own state). 

It can be observed that the closed-loop system of (1) 
using (3) is nonlinear and the stability analysis is, in gen- 
eral, difficult because the closed-loop system is nonlinear 



and switching in the presence of unknown terms. By using 
Corollary 3.3, the stability of (1) using (3) can be guaranteed 
by the stability of another nonlinear system, whose stability 
can be analyzed. In addition, the unknown dynamics do not 
appear in the new nonlinear system. 

When the unknown inherent nonlinear dynamics do not 
exist, we have the following corollary. 

Corollary 4.4: Consider agents with single-integrator kine- 
matics 

ii = Ui, i = 1, ■ • • ,n (25) 

where xi £ R is the state of the ith agent and u,i £ R is the 
control input for the ith agent. Let the consensus algorithm 
for (25) be given by 



-e^a.y(i)sig(xi - xj) c 

3=1 



(26) 



where e is any positive constant, < a* < 1, and Oij(t) 
is the (i,j)th entry of the adjacency matrix A(t) at time 
t. Assume that the interaction graph Qi,i = 0, 1, ... , has a 
directed spanning tree. Then Xi(t) — xj(t) — > in finite time. 
Proof: The corollary is a direct result of Theorem 4.1. ■ 

Remark 4.5: In [21], it is shown that finite-time consensus 
is reached if the directed fixed graph has a directed span- 
ning tree and each strongly connected component is detail- 
balanced. In Corollary 4.4, we show that finite-time consensus 
is reached if the directed switching graph has a directed 
spanning tree at each time interval. Then it is natural to 
ask if the condition on the interaction graph can be further 
relaxed to the case when the interaction graph has a directed 
spanning tree in some joint fashion in terms of a union of 
its time-varying graph topologies (see, e.g., [2] for details). 
Unfortunately, the relaxed condition on the interaction graph 
containing a directed spanning tree in some joint fashion, 
in general, cannot guarantee finite-time consensus, or even 
asymptotical consensus. For example, consider three agents 
with ri(0) = 0, r 2 (0) = 1, and r 3 = 2. Let a 2 3 = 1 for 
a period of t\ such that r-2{t\) = rs(ti) with other entries 
in A equal to zero. Then let 031 = 1 for a period of i 2 
such that r^(ti + f 2 ) = ri(ii + i 2 ) with other entries in A 
equal to zero. By continuing a similar process, both maxj Ti 
and mini ?*i keep unchanged, which implies that consensus 
cannot be achieved even if the interaction graph has a directed 
spanning tree jointly. 

Remark 4.6: Another interesting finite-time consensus al- 
gorithm for (25) is given in [20] by 



Ui = -esig 



(27) 



where e is a positive constant. It is shown in [20] that finite- 
time consensus is reached for (25) using (27) when the directed 
fixed interaction graph Q has a directed spanning tree. When 
the interaction graph ft, i = 0, 1, . . . , has a directed spanning 
tree, by following a similar analysis to that in the proof of The- 
orem 4.1, it can be shown that consensus is reached in finite 
time for (25) using (27). Note again that the relaxed condition 
on the interaction graph containing a directed spanning tree 
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in some joint fashion as mentioned in Remark 4.5, in general, 
cannot guarantee finite-time consensus. 

Inspired by the main idea behind the proof of Theorem 4. 1 
for (3), another finite-time consensus algorithm for (1) is given 
by 

n n 

Ui = -k^2a i j(t)(r i -r j )-(3^2a i: j(t)sig(r i -r : j) a \ (28) 
3=1 3=1 

where k and (3 are positive constants, and a* G (0, 1) 
is a positive constant. By following a similar analysis to 
that in the proof of Theorem 4.1, it can be shown that 
consensus is reached in finite time when the interaction graph 
Qi,i — 0,1,..., has a directed spanning tree, k > a ^ ^ , 
and j3 > 0. The main idea behind (28) is that the linear 
term — &2~^j=i a ij W( r J ~ r j) lS use d to compensate for 
the unknown inherent nonlinear dynamics such that asymp- 
totic consensus can be achieved while the nonlinear term 

— /3 T^j=i a ij W s ig( r « — r j) a i s use d to guarantee finite-time 
consensus in the absence of the unknown inherent nonlinear 
dynamics. In the absence of the unknown inherent nonlinear 
dynamics, the use of the linear term is helpful (or at least 
harmless) for the nonlinear term to achieve finite-time con- 
sensus. Similarly, in the presence of the unknown inherent 
nonlinear dynamics, the use of the nonlinear term is helpful 
(or at least harmless) for the linear term to achieve asymptotic 
consensus. More precisely, both terms are harmless to each 
other in terms of each individual objective. Here an interesting 
idea is provided regarding the design of proper algorithms 
motivated by those algorithms under some similar situations. It 
is possible that a summation of various algorithms can be used 
to achieve some combinatorial objective if those algorithms 
are chosen properly. In addition, the stability analysis tool 
proposed in Section III provides important insights as to 
the connection among the closed-loop systems using those 
algorithms. 

We next consider a special case when the nonlinear part 
of (28), namely — /3X}j=i aij(i)sig( r ; ~ r j) a > does not exist. 

Corollary 4.7: Assume that the directed interaction graph 
Qi, i = 0, 1, . . . , has a directed spanning tree. Using 

n 

Ui = -fc^a y (t)(r i - rj) 

3 = 1 

for (1), \ n (t) - rj(t)\ -+ as t -> oo if k > + € ^ 

where q n is the maximal positive number such that (8) holds 
and Ck, k = 1, 2, is any positive constant. 

Proof: The proof is similar to that of Theorem 4.1. ■ 
Remark 4.8: In contrast to [31] where asymptotical consen- 
sus for (1) was studied under some fixed interaction graphs, 
Corollary 4.7 presents more general results for the case of a 
directed switching interaction graph. 

V. Simulation 

In this section, a simulation example is presented to validate 
the theoretical result presented in Section IV. We consider a 
group of 4 agents in the one-dimensional space {i.e., m = 1) 



with the interaction graph switching from {G(i), Q(2)} ( see 
Fig. 1) every 0.5 seconds. By computation, q% = 0.6910. 
In particular, a,ij(t) = 1 if (j, i) <E W(i) and Oy (t) = 
otherwise. By choosing f(t, n) = sin(?'i), it then follows that 
\f(t, Ti) — f(t, Tj)\ < Ti — rj \. We then choose /3 = 3, which 
satisfies the condition on /3 given in Theorem 4.1. We further 
choose a* = 0.8 and r(0) = [f , -f , -f , -f ] T . 

Fig. 2 shows the trajectories of the four agents under the 
proposed consensus algorithm (3). The evolution of G{r) = 
maxi ri — min^ is given in Fig. 3. To better show the finite- 
time convergence, the evolution of log(l + max^ ri — min^ r^) 
is shown in Fig. 4. Recall that max; r; — min^ ri = if and 
only if log(l + max; — min.; r^) =0. It can be noticed from 
Figs. 3 and 4 that all agents reach consensus in finite time. 
Moreover, it can be seen from Fig. 3 that G(r) might increase 
at some time intervals, indicating that G(r) is not a Lyapunov 
function. 

®- — © ® — KD 

© — KD d> — ® 

(a) G(i) (b) 5(2) 

Fig. 1. Directed graphs and Q(2) ■ Both of them have a directed spanning 
tree. An arrow from j to i denotes that agent j is a neighbor of agent i. 



VI. Conclusion 

In this paper, we studied finite-time consensus of multi- 
agent networks with unknown inherent nonlinear dynamics. 
First, we proposed a novel stability tool based on a generalized 
comparison lemma. With the aid of the novel stability analysis 
tool, we analyzed the stability of the closed-loop system using 
the proposed distributed nonlinear consensus algorithm by 
comparing the original closed-loop system with some well- 
designed closed-loop system that can guarantee finite-time 




t (sec) 

Fig. 2. The trajectories of the four agents using (3). 
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t (sec) 

Fig. 3. The evolution of max; r, — mini fi with respect to t. 



0.7 




t (sec) 

Fig. 4. The evolution of log(l + max; r, — min^ rj) with respect to t. 



consensus. In particular, the stability and finite-time conver- 
gence using the proposed nonlinear consensus algorithm under 
a (general) directed switching interaction graph were shown 
to be guaranteed by those of some special well-designed 
nonlinear closed-loop system under some special directed 
switching interaction graph. As a byproduct, in the absence 
of the unknown inherent nonlinear dynamics, the proposed 
nonlinear consensus algorithm can still guarantee finite-time 
consensus under a directed switching interaction graph. 

References 

[1] R. Olfati-Saber and R. M. Murray, "Consensus problems in networks 
of agents with switching topology and time-delays," IEEE Transactions 
Automatic Control, vol. 49, no. 9, pp. 1520-1533, September 2004. 

[2] W. Ren and R. W. Beard, "Consensus seeking in multiagent systems 
under dynamically changing interaction topologies," IEEE Transactions 
Automatic Control, vol. 50, no. 5, pp. 655-661, May 2005. 

[3] M. Cao, A. S. Morse, and B. D. O. Anderson, "Agreeing asyn- 
chronously," IEEE Transactions Automatic Control, vol. 53, no. 8, pp. 
1826-1838, September 2008. 



[4] F. Xiao and L. Wang, "Consensus protocols for discrete-time multi- 
agent systems with time-varying delays," Automatica, vol. 44, no. 10, 
pp. 2577-2582, 2008. 

[5] Y. Hatano and M. Mesbahi, "Agreement over random networks," IEEE 
Transactions Automatic Control, vol. 50, no. 11, pp. 1867-1872, Novem- 
ber 2005. 

[6] C. W. Wu, "Synchronization and convergence of linear dynamics in ran- 
dom directed networks," IEEE Transactions Automatic Control, vol. 51, 
no. 7, pp. 1207-1210, July 2006. 

[7] M. Porfiri and D. J. Stilwell, "Consensus seeking over random weighted 
directed graphs," IEEE Transactions Automatic Control, vol. 52, no. 9, 
pp. 1767-1773, September 2007. 

[8] A. Tahbaz-Salehi and A. Jadbabaie, "A necessary and sufficient condi- 
tion for consensus over random networks," IEEE Transactions Automatic 
Control, vol. 53, no. 3, pp. 791-795, April 2008. 

[9] G. Xie, H. Liu, L. Wang, and Y. Jia, "Consensus in networked multi- 
agent systems via sampled control: Fixed topology case," in Proceedings 
of the American Control Conference, St. Louis, MO, 2009, pp. 3902- 
3907. 

[10] , "Consensus in networked multi-agent systems via sampled con- 
trol: Switching topology case," in Proceedings of the American Control 
Conference, St. Louis, MO, 2009, pp. 4525^1530. 

[11] Y. Gao and L. Wang, "Consensus of multiple double-integrator agents 
with intermittent measurement," International Journal of Robust and 
Nonlinear Control, vol. 20, no. 10, pp. 1140-1155, 2009. 

[12] Y. Cao and W. Ren, "Multi-vehicle coordination for double-integrator 
dynamics under fixed undirected/directed interaction in a sampled-data 
setting," International Journal of Robust and Nonlinear Control, vol. 20, 
no. 9, pp. 987-1000, 2010. 

[13] L. Fang and R J. Antsaklis, "Asynchronous consensus protocols using 
nonlinear paracontractions theory," IEEE Transactions Automatic Con- 
trol, vol. 53, no. 10, pp. 2351-2355, November 2008. 

[14] A. Kashyap, T. Basar, and R. Srikant, "Quantized consensus," Automat- 
ica, vol. 43, no. 7, pp. 1192-1203, 2007. 

[15] R. Carli and F. Bullo, "Quantized coordination algorithms for ren- 
dezvous and deployment," SIAM Journal on Control and Optimization, 
vol. 48, no. 3, pp. 1251-1274, 2009. 

[16] J. Cortes, "Finite-time convergent gradient flows with applications to 
network consensus," Automatica, vol. 42, no. 11, pp. 1993-2000, 2006. 

[17] S. Sundaram and C. N. Hadjicostis, "Finite-time distributed consensus in 
graphs with time-invariant topologies," in Proceedings of the American 
Control Conference, New York City, NY, 2007, pp. 711-716. 

[18] X. Wang and Y. Hong, "Finite-time consensus for multi-agent networks 
with second-order agent dynamics," in IFAC World Congress, Seoul, 
Korea, 2008, pp. 15 185-15 190. 

[19] Q. Hui, W. M. Haddad, and S. R Bhat, "Finite-time semistability 
and consensus for nonlinear dynamical networks," IEEE Transactions 
Automatic Control, vol. 53, no. 8, pp. 1887-1890, September 2008. 

[20] F. Xiao, L. Wang, J. Chen, and Y. Gao, "Finite-time formation control 
for multi-agent systems," Automatica, vol. 45, no. 11, pp. 2605-2611, 
2009. 

[21] L. Wang and F. Xiao, "Finite-time consensus problems for networks of 
dynamic agents," IEEE Transactions Automatic Control, vol. 55, no. 4, 
pp. 950-955, 2010. 

[22] X. Wang and Y. Hong, "Distributed finite-time x-consensus algorithms 
for multi-agent systems with variable coupling topology," Journal of 
Systems Science and Complexity, vol. 23, no. 2, pp. 209-218, 2010. 

[23] T. Nishikawa, A. E. Motter, Y.-C. Lai, and F. C. Hoppensteadt, 
"Heterogeneity in oscillator networks: Are smaller worlds easier to 
synchronize?" Physical Review Letters, vol. 91, no. 1, p. 014101, 2003. 

[24] J. Lu, X. Yu, and G. Chen, "Chaos synchronization of general complex 
dynamic networks," Physica A, vol. 334, no. 1-2, pp. 281-302, 2004. 

[25] J. Lu and G. Chen, "A time-varying complex dynamical network 
model and its controlled synchronization criteria," IEEE Transactions 
Automatic Control, vol. 50, no. 6, pp. 841-846, 2005. 

[26] J. Zhou, J. Lu, and J. Lu, "Adaptive synchronization of an uncertain 
complex dynamical network," IEEE Transactions Automatic Control, 
vol. 51, no. 4, pp. 652-656, April 2006. 

[27] C. Wu, Synchronization in complex networks of nonlinear dynamical 
systems. World Scientific, Singapore, 2007. 

[28] G. Chen, X. Wang, X. Li, and J. Lu, "Some recent advances in complex 
networks synchronization," in Recent Advances in Nonlinear Dynam- 
ics and Synchronization, ser. Studies in Computational Intelligence. 
Springer, 2009, pp. 3-16. 

[29] W. Yu, G. Chen, M. Cao, and J. Kurths, "Second-order consensus for 
multi-agent systems with directed topologies and nonlinear dynamics," 



13 



IEEE Transactions on Systems, Man, and Cybernetics - Part B: Cyber- 
netics, vol. 40, no. 3, pp. 881-891, 2010. 
[30] H. Su, G. Chen, X. Wang, and Z. Lin, "Adaptive second-order consensus 

of networked mobile agents with nonlinear dynamics," Automatica, 

vol. 47, no. 2, pp. 368-375, February 2011. 
[31] W. Yu, G. Chen, and M. Cao, "Consensus in directed networks of 

agents with nonlinear dynamics," IEEE Transactions Automatic Control, 

vol. 56, no. 6, pp. 1436-1441, June 2011. 
[32] A. F. Filippov, Differential Equations with Discontinuous Righthand 

Sides. Kluwer Academic Publishers, 1988. 
[33] A. N. Michel and R. K. Miller, Qualitative Analysis of Large Scale 

Dynamical Systems. New York: Academic Press, 1977. 
[34] D. D. Siljak, Large-Scale Dynamic Systems. New York: North-Holland, 

1978. 

[35] F. Xiao, L. Wang, and Y. Jia, "Fast information sharing in networks of 
autonomous agents," in Proceedings of the American Control Confer- 
ence, Seattle, WA, 2008, pp. 4388^4393. 

[36] H. K. Khalil, Nonlinear Systems, 3rd ed. Upper Saddle River, NJ: 
Prentice Hall, 2002. 

[37] A. Bacciotti and F. Ceragioli, "Nonpathological Lyapunov functions and 
discontinuous caratheodory systems," Automatica, vol. 42, no. 3, pp. 
453^58, March 2006. 

[38] T. Apostol, Mathematical Analysis. Reading, MA: Addison-Wesley, 
1974. 



